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5. If m observations are made of a quantity M which is a known func- 
tion of n unknown quantities a;, y, 2, ... to we have a determinate problem 
if m = w. However if m > w as we have supposed, the problem admits of 
an infinite number of contradictory systems, since each observation is liable 
to error. It is a logical necessity to remove these contradictions and this is 
done by applying corrections to the observed quantities M-^^, if 2 .... M^y 
which may be Jj, A^, .... J„, respectively. Since we have no rigorous 
condition to determine these corrections we may ask for the most probable 
system of corrections and this problem may pe solved by the principles al- 
ready explained. 

Assuming the observations to be of equal precision, (if not, they may be 
reduced to the same precision by (26) if the precisions are given or some 
numbers proportional to them,) we have, if the probable error of observation 
is r, the compound probability of the errors J^, Jjj • • • • ^mj to be com- 
mitted in any order 

(44) P = ^^e-7^[A']. 

If this probability shall be a maximum then 

(45) [^0 = ^ minimum, 

if the subscript denotes that the corrections already satisfy the condition. 
Now let i!f be a linear function oi x, y, z, . . . . w, [if not we can prepare 
it as (34"),] or let Jlf be of the form 

(46) if = ax + by + ez -{- . . . .bo -^ k, 
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then we have for each observation, replacing JIfj — h, M^ — h, ... M^ — ^ 

by fi^, fi^,.... fim, and supplying corrections 

(47) a^x + b^y + e^^z + .... + l-^w — fti = Ai 

«2« + &22/ + CgS + + ZgW — ;«2 = ^2 



«m« + Ky + e^e + + Lw — fi^ = K 

By (45) we must have 





dx dy dz " ' ' ' dw 


(48) 






^^t-^^^f ■^••••^»^™=^ 




^^'^+^^'i+--^"-t=^' 


but by (47) 




(49) 


dx ""'' dx' ""'■•'• dx "- 




d2,-*i' dy-^'"-- dy *"• 




f^'^l _ 7 . <^^2 _ 7 <^^m __ 7 

d«> ~ 'i' dw 2 '••• dw •" 



or 



These values substituted in (48) give 

(50) «! Ji + (12^2 + a^J^ - [_aJ] = 

6i Jj + 62 ^3 + . . . . 6»^« = [6zf| ^ 

^1^.1 + ^2^2 + • • • • ^™^» -: [M] = 0. 
Multiplying (47) in their order hy a^, a^ . . . • a^^ and adding the pro- 
ducts, then also taking the sum of the products hj b^jb^, . . • . b„ and so 
on we obtain regarding (50) 

(51) laF\x + labjy + [ao]z + .... + [«?> — [a/i] = [aJ] = 
iab']x+ [6% + lbo]z + ....+ IbQw — [6//] =. [6^1] = 
[ac]a; + [6% + [c^]^ + • • • • + Ig^w ■— [eflj = [c J] = 

{aqx + [6% + ld]z + .... + P> -- [^/«] = P O = 0. 
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These equations which are called normal equations will give those deter- 
minate values of x, y, z which are rendered most probable by the observa- 
tions. 

Multiplying (47) in succession by — /^j, - — /igj > • • • — /"» ^^^ adding 
the products we have also 

— [«/z]a; — [bf/jy — [c/*> — ..., — p;z]w + |>2] = — [^J] 
and since the sum of the products hj d^, d^, . , , , /i^ 
\_al\x + [bl]y + \cl\z + .... + [/J]«, - IjiA-] = - |> J] = [A% 
we have 
(52) - McB - \hfi\y _ [c/.> - , . . . - \lil\w + OT = iA\. 

Having found x,y,z, . . . . w hj (51) we can find the sum of minimum 
squares of the corrections [//^Jq by forming also the quantity \jf]. We have 
then by (23') 

and by (30) the probable error of the corrections 

(-) ^.-^1(^-^)- 

This formula is of course only approximately true and rests ou the assump- 
tion that the system of corrections A^, A^, . . . . A„^ sufficiently near corres- 
ponds to the ideal case in article 2. This must be the case as nearly as 
possible since it is the most probable system of corrections. 

6. We next determine the probable errors of x, y, z, . . . . w. It is 
plain that these unknown quantities must be some linear functions of i^i, fJt^, 
.... /4j, so that we may assume 

(54) X — a^fiy -h fta/^a + ««/<« = M 

« • • • 

The probable error of observation or that of /ij, /Zj? • • • • /V being r, we 
have by (43') 

(55) r,= »-i/M 

• • • • • 
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Substituting (54) into (47), (50) and (52) we have 
(47') aiM + 6i[/9/^] + CiEr//] + .... + ^M - /^i = ^i 
02M + b^l^/x] + c^lxfi] + + ^2^ — /^2 = ^2 

am[afl] + K[Pli\ + CmM + + LM — J«m = ^m 

(500 MM + WM + MM + . . . . MM - M=o 
[a6]M+ [i']l^/'] + MM + . . • . pqM-M=o 
[ac]M+ MD?/'] + [o'^lM + . . • . [c^M - M=o 

MM + MI^)«] + MM +•.... [^']M - M = 0. 
(52')-MM-MD?/']-MM-. . . -[MM-M = mo. 

The coefficients «i, a^ , . . . a„; ^j, jSg, .... being independent of [i^, 
f^%i ' • • ' t^m^^ have, resolving (50'), 
(56) [a^fli + [a6]i9i + [oc>i + M^i = a^ 



[a6]ai + [62]^i + [6c]rj + . . . . \bqx^ = 61 
[a&]«2 + [62]i32 + [icjra + ■ • • • M^2 = ^2 

[aq«i + [6r]i9i + [crin + . . . . [z^ j^^ = ^^ 

[ai]«2 + [6Z]i32 + [cr|r2 + . . . . [Z2]^2 = l^. 

Taking sums of products by a^, a^t . . . then by b^y b^, . . . by Cj, Cg, . 
and so on, we easily see that we must have 

(57) laa-] = 1; [6a] = 0; [c«] == Oj [fa] = 

[a^] = ; [6^] = 1 ; [c/9] = ; . . . . [i^] = 



laX] = 0; [6;i] = 0; [cA] =0; [M] = 1. 

We have then, taking the sum of the products of (56) by aj, a^, .... 
(58) [a2][«2] + [a5][«/3] + [oc][ar] + [aq[aA] = [aa] = 1 

MM + [6']M + [6c][«r] + . . . . [6r| [«A] = P«] = o 

[ac][a^] + [6c][ai3] + [c?][«r] + . . . . [cri[fla] = [ca] = 
[aq [«^] + [6rj[«^] + [c^][ar] + . . . . [Z2][ai] = [;«] = 0. 
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Multiplying the first equation of (51) by [a^], the second by [a^^, the third 
by [a^] .... the nth. by [aX] and adding the products we have by virtue 
of (58) 

(59) X = MM -u [a/3][5/.] + [ar]M + . . . + [«A]M. 
In a similar manner we can determine y from the system 

(580 MM + [«i]OT + [«o][^r] + . . ■ laUim = [«/?] - 

[a6][«i9] + [62][^2] + [6c][^j-] + . • . [5Z][/3x] = [6/3] = 1 



[«0M + [6«]OT + bmm + ■•■ u'lm'] = u^i == o- 

(59') 3, = MM + [^''JP/.] + [MM + . . . + [/3^.][M, 
and so on for the other unknown quantities. 

To determine now the probable error of observation or that of ^j, p-^,.. 
Hm we have from (47'), omitting subscripts, 

pi = «[«,«] + &[/?j«] + 6\ypi] + . . . . l[}.[i\ — -4. 
We have then the relation of probable error by (43') 



+ (aa2 + 6^2 + o}-2 . . . ^-^2)" 

+ 

+ (aa„ + 6jS^ + ej-m . . . ^4)'' 

= a\a^'] + a6[«/9] + aolajl + 
+ a6[«^] + 6^[(323 + 6c[i3r] + 

+ 

+ aliaX\ + 6^[/9A] + cZ [rA] + . 



A 



. &Z[/3A] 



J.Z 4. ,. 



A 



Restoring subscripts and taking sum of all these equations we have 



. [al] [aX] 



(60) mr' = [a2] [«2] + [«&] [a^] + [ao] [ay] + 
+ [a6][«^]+ [62] 032] + j;ie][/3r] + 

+ 

+ [arilaX} + [6;][/3A] + [cqC^A] + . . . [^2] [^2] 

= wr^ + mr^ by virtue of (58), (58'), 

We have then the remarkable relation 



r^ + mr 



A 



(61) 

hence by (53) 

(62) 



( m 

*" = >'A-% "S 

"\m — n 






This value being used in (55) we have also the probable errors of the un- 
known quantities. 
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7. If the observations are of different precision we must reduce them 
first to the same precision according to (26). Usually this is done however 
by means of weights, which are numbers proportional to the square of the 
precision, or what is the same thing proportional to the reciprocal square of 
the probable error. Thus if in last article we assign to an observation the 
weight unity those of x, y, z, . . . w are 

(63) px== T^> ■^^~Tl2]' • ' ' P« — TJ^J 

If then, as usual, weights are given we reduce the observations to the same 
precision if we multiply them by the square root of the weight and then 
proceed as in last article. Formula (62) gives then the probable error of 
that standard of observations to which they all have been reduced. 

8. If there is only one nnknown quantity x, (47) becomes 

(64) a^x -- ;«! = ^1 

<^Z^ — /<2 = ^2 

9 • A a • • 

«»!» — fl„ = Jm 

These equations being of equal precision by hypothesis the coefficients 
«!, a2> <*m may be understood to be ratios of the actually observed quantity 
to the quantity sought, for instance, as if the quantity had been magnified 
in different degrees or repeated a different number of times. We have then 
from the first of (51) 

(65) X = lafi] -T- [a% 
and from the ficrst of (58) 

(66) [«T = 1 -^- [a% or p, = [a?]. 

We have also the probable error of observation by (62) 



(67) ^ = ^^12^1-' 



m-l)[a'j 



hence 

If however we place 
(69) a?! = )Ki H- Oi ; 3^ = J^-^ a^ 

s'a = /'2 -^ «2 ; ^2 == ^2 "^ <^2 



^m — f^m '• ^mi "m — "m '• ^m> 

we have the equations of condition 

(70) X — a;j = ^1 (precision aj or weight af) 

x-x^ = d^ ( « a^ « « al) 

x — x^ = d^ ( « a™ « « al). 
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We find after reducing to same precision 

(71) a,==I^ = M 

(72) Px= Up] = sum of weights of individual obs. 

Suppose now that a^^ = a^ = . . . am or pj^ = p^ = . . . Pm, then the 
weighted mean (71) becomes the arithmetic mean and we have 
(71') a; == [a;] -4- m 

(720 p^= m 

(740 ,.^ = /,J 2[^_ 

9. The above short essay contains every essential principle of the method 
of least squares, though only a small part of the many interesting develop- 
ments. I merely sketch out a method of treating the general problem of m 
observations for n unknown quantities. It consists in determining the prob- 
ability of the system relatively to the unknown quantities. 

We had (44) 

the probability of the system relatively to the unknown quantities is then 

,„f.s jj Pdxdydz . . . dw 

i dw ... i dz I dy i Pdso 

and that of one unknown quantity for instance w 

... \ dz \ dy \ Pdx 

I dw I . . . I da I dy I Pdx 



